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Team Leadership and 
Communication 

• Good leadership and regular communication are needed 

• Regular forums for information exchange 

- Weekly technical team meeting keeps everyone on same page 

• consists of team leader, discipline leads, instrument/calibration lead, data system leads and 
outreach lead 

- Full Science Team meetings 

• twice per year early in mission (once per year later) 

- Weekly calibration and data system meetings 

• Science Team members funded before and through the life of the 
instrument - a long term commitment and experience base is critical 

• Disciplines - Discipline Leads and a core full-time group built around the 
data systems with weekly discipline telecons 

- Close working relationship between data team and science team members is 
important 

• Calibration - core calibration group working with discipline representation 

- Discipline representatives provide important feedback because they understand 
calibration and its impact on fundamental (upstream) science products (e.g. water 
leaving radiance, land surface temperature, land surface reflectance, aerosols) 
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Data Systems 



• Science testing 

- Don’t bundle too many changes together - impacts of upstream algorithms are hard 
to untangle 

- Many iterations of testing are needed 

- Storage is needed for multiple baselines and changes 

- Carefully control for ancillary data dependencies 

- Maintain a basic set of science test days 

• Reprocessing: It should be possible do a minimum of entire mission in 1 year 

- 2X forward plus more than IX per mission-year 

- Ideally should be able process mission in 3 months or less (requires 10X to 100X) 

- Having Level 0 data on-line makes science testing and reprocessing much easier 

- Disciplines will have their own reprocessing schedules 

- So the reprocessing data system needs to be able to handle this 

- Multiple strings may be needed for individual disciplines 

• Test system (separate string) should be minimum of IX; ideally 4X to 10X 

- Can double as reprocessing string 

• It was useful to have the same algorithms across multiple sensors 

- For Ocean Color, adapting the heritage SeaWIFS algorithm for Aqua made it 
possible to produce a good quality product 
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Algorithm Development, 
Integration and Testing 



• ST members should play a key role in development and maintenance of code 
remain responsible 

- It is better to produce some experimental products at the Scientist Team Member’s 
Computing Facility - but a method is needed for eventually bringing code into the 
primary production facility 

• Science team led processing is needed to ensure that the best products are 
generated and reprocessed with a workable schedule 

• Stable calibration and algorithms are needed to produce a good time series 

- Don’t make changes in middle of reprocessing 

- Minimize changes in forward processing (after calibration and algorithms stabilize) 

• Improved Aqua instrument characteristics made some products possible, 
e.g. Ocean Color, Deep Blue Aerosols 

• Process for bringing in new products needs to be streamlined because of the 
current 3-year proposal cycle 

- Ocean group has developed a well-defined process that allows for community 
feedback 
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Quality Assurance 






• Centralized QA activities for each discipline is invaluable 

• Land group has the following functions: 

- Global browse and golden tiles 

- Subsets and QA database 

- Known issues pages 

- Initial point of contact for user’s quality concerns 

- Help in tracking quality issues to source (sometimes in the upstream 
algorithm) 

- Coordination and feedback on science algorithm testing 

• Atmosphere team makes available: 

- Projected granule browse of LIB and key atmosphere products 

- Images of hundreds of L3 global parameters including min, max, standard 
deviation fields 

- Collection highlights and known issues 

- Standard visualizations of all test data for the science team 

• Ocean team offers similar capabilities 
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Distribution 



• Key communities will need specialized products 

- Products in Climate Modeling Grid for climate modelers 

- Near Real Time products for applications users 

- Plan for additional formats and tailored products 

- One map projection (grid spacing, etc.) will not work for all users (or even a 
majority) 

• Self document format (HDF) is useful - but additional formats are needed 

- Geographic information system users have community format standards (not HDF) 

• Always have a full collection going forward 

- Reprocess the full mission in background 

- Give users time to switch over to new dataset 

• On-line products (including Level 0) greatly increased distribution 

- Made getting data much easier and increased speed of fulfilling orders 

- Enables processing-on-demand for tailoring products as well as web services 

- Need to perform trade study between processing-on-demand vs. storing products 
on a product by product basis 
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Applications and Outreach 



• Near Real Time (NRT) data system is needed for application users 
(MODIS Rapid Response experience) 

- Stand alone NRT system is needed to avoid gearing the entire production 
stream to the NRT constraints 

- Should be developed once the instrument has stabilized and data products 
are at Stage 1 Validation 

- Direct Broadcast (DB) versions of code make it easier for broad product 
uptake and use - increases standardization 

- DB encourages applications and regional algorithm development and has 
been a huge success with >100 direct readout sites worldwide 

- Some products originally developed by application users (e.g. Polar Winds) 
could be considered as future standard products 

• Targeted outreach program is needed 

- Imagery support is needed for outreach 

- Earth Observatory for one-stop shopping - must include good descriptions 
(captions) - this is a good way to deal with the Media 


May 17, 2011 - Wolfe 


9 



MODIS Ocean Lessons Learned 


Source: Fred Patt, OCDPS 


Summary of MODIS Ocean 
Lessons Learned 



• Overall success of the effort depends critically on collaboration 
between the Ocean and Calibration teams and on a robust Calibration 
and Validation program. 

• Development of Climate Data Records (CDRs) from multiple 
instruments is best performed in discipline-specific measurement- 
based systems. 

• Products should be developed and validated in stages, with the initial 
products validated and mature before the downstream products 

• A well-defined, rigorous process is needed for adding new products in 
cooperation with external team members. 

• Data system needs to be flexible to accommodate both regular 
algorithm updates and continual technology advancements 

• Effort needs to be visible and linked to the external science 
community. 
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Improvements in MODIS/SeaWiFS nLw Comparisons 
Resulting from Revised Polarization Correction 


MODISA[ATa2)/EadWiF3(3T101) 4-Day nLw Ratio®, PacN35 Subset 


MODISA[ATaB)/EadWiFS(3T101) 4-Day nLw Ratio®, PacN35 Subset 




1.4 


1.2 


I 

| 1.0 
J 


D.B 


o.e 


MODISA[ATOe)/SaaVYiFE[SK)1] 4- Day nLw Ratios, PacS45 Subset 



MODISA[AT02)/SaaVYiFE[SK)1] 4- Day nLw Ratios, PacS45 Subset 
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The SeaWiFS Bio-Optical Storage System (SeaBASS) - 
In situ Data Submission, Archive and Search 



AQUA 








10 Jul 20(19 - SeaBASS data [minis 




Ocean Color Web Site - One-stop Shopping for 
NASA Ocean Data Products 



MISSIONS SUPPORTED 


oceancolor.gsfc.nasa.gov 


• MODIS (Terra and Aqua): 

2000 - present 

• SeaWiFS: 1997 - present 

• CZCS/Nimbus-7: 1978-1986 

• OCTS/ADEOS-I: 1996 - 1997 

• Glory data system prototype: 

2009 launch 

• Aquarius/SAC-D: 

May 2010 launch* 

• VIIRS/NPP: January 2011 launch 

• Community Processing & Analysis 

Software SeaDAS (1991 -present) 
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( Ocean Color Forum - A Tool for User Support 

and Community Interaction 





Ocea 


P Ool or 
Drum 


Ocean Color Forum - Welcome, fred 

Forum Ocean Color Home Help Search Options Logout 

Board Products and Algorithms / Satellite Data Products & Algorithms 
Add Topic New Posts Unread Posts ToDo Info 

Discussion of ocean color algorithms, atmospheric correction methods, satellite sensor calibration, derived products. 

ropic Poster 

M comparability of CZCS and SeaWiFS rgasch 

■ Level 2 SST Cloud Mask mhess 

M Confused Lw , nLw , Rrs , Diff_tran 7 WangFeng 

M Don't understand taua_865 values extracted from seawifs? dadiouf 

M trend in oligotrophic chla Jaime 

M kparfrom k490 fields 

M Level 3 - SeaWiFS chlorophyll data martinssei 

M SST measurement depth Anonymou 

Fa stitch two seawifs scenes balu 

Fa L2geri output detail balu 

Pa MODI5L1DB - vertical stripes in MOD03 geolocation output vanu 

Fa BL3MAP raghuBJO 

Fa Volcanic ashes from modis or other platform emolina 

Fa biological oceanography Lapucci 

MO vs MO_XS Ryan We at 

Ri aerosol optical depth generated for MODIS images boredlim 

Fa foam radiance Elva 

Fa Chlorohyll comparison SeaWiFS and Modis derived neera 

Fa Chlorophyll average - own algorithm Lapucci 

Fa MUMM correction hesselmar 

Fa Level 2 Processing Flags in SeaDAS angira 

Fa source of NCEP.MET data slava 

Fa Land reflectance kara 

Fa Clark's algorithm failure in high suspended matter ajis 

Fa How should I show a citation on a fabricated product? khiromi 


□ n o 

1 2 3 4 5 6 7 8 ... 25 B B 


Poster 

Posts 

Last Post 

rgasch 

1 (1 new) 

2009-07-10 19:18 

mhess 

2 (2 new) 

2009-07-09 20:07 

WangFeng 

3 (3 new) 

2009-07-02 00:00 

dadiouf 

5 (5 new) 

2009-06-30 14:42 

Jaime 

8 (4 new) 

2009-06-23 18:33 

fields 

3 (3 new) 

2009-06-19 03:06 

martinssequeira 

19 (19 new) 

2009-06-16 14:19 

Anonymous 

6 (2 new) 

2009-06-11 20:49 

balu 

2 (2 new) 

2009-06-10 17:38 

balu 

5 (5 new) 

2009-06-02 22:59 

vanu 

4 (4 new) 

2009-05-28 17:52 

raghu330 

3 (3 new) 

2009-05-26 14:56 

emolina 

2 (2 new) 

2009-05-18 16:24 

Lapucci 

3 (3 new) 

2009-05-12 08:18 

Ryan Weatherbee 

2 (2 new) 

2009-05-08 14:03 

boredlim 

2 (2 new) 

2009-04-28 15:23 

Elva 

2 (2 new) 

2009-04-28 15:20 

neera 

1 (1 new) 

2009-04-28 14:45 

Lapucci 

12 (12 new) 

2009-04-24 15:20 

hesselmans 

17 (3 new) 

2009-04-23 21:58 

angira 

2 (2 new) 

2009-04-17 18:41 

slava 

3 (3 new) 

2009-04-15 07:03 

kara 

4 (4 new) 

2009-04-14 00:15 

ajis 

2 (2 new) 

2009-04-03 17:23 

khiromi 

2 (2 new) 

2009-03-27 13:10 


- Satellite Data Products & Algorithms 


Responsible NASA Official: Gene C. Feldman 
Curator: OceanColor Webmaster 
Authorized by: Gene C. Feldman 
Updated: 27 November 2007 


Privacy Policy and Important Notices 
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SeaWiFS Data Analysis System (SeaDAS) - 
Desktop Ocean Data Processing and Analysis 



Daoijments Confect Links OceanCofar rteivs 


The SeaWiFS Data Analysis System 
<SeaDAS> is a comprehensive image analysis 
package for the processing, display, 
analysis, and quality control of ocean color 
data. 


SeaDAS Virtual Appliance 
released for Windows! 


Support 


Ocean Color Web 
Ocean Color Forum 
Ocean Mailing Lists 


SeaDAS VA 5 A albws SeaDAS to 
be run on Microsoft Windows XP and 
Vista systems within a virtual Linux 
machine. This is a fully functional 
version of SeaDAS and processing 
benchmarks show very impressive 
performance. 


Download and Installation 


SeaDAS VA is simple to install and 
requires the free VMware Player. 


Online Auto-I n s tal latio n 
Manual Download 
Manual Installation 


Wraotw: 


Supported satellite sensors are 
MODES, SeaWiFS, OCTS, and CZCS. 


SeaDAS Virtual Appliance 


Sate llite Data Info 


o Features 
O Requirements 
O Online Help 
O SeaDAS FAQ 
O User C ontributed Software 
O History of Events 
° Distribution Statistics 


Data Product Specifications 
Data Format Specifications 
Processing Versions Chart 


MODISL1DB 1.5 released 


Satellite Data Access 


Level Land 2 Browser 
Level 3 Browser 
Data by FTP 
Ancillary data 
Data Subscriptions 
Data File Search Utility 


U se r C ontr ibuted Software 


Do yo u have programs to share 
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MODIS Atmosphere Lessons 

Learned 


Source: Bill Ridgway 
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Summary of MODIS Atmosphere 

Lessons Learned 



• Atmospheric parameters are very dynamic, requiring validation at 
varying time and distance scales. 

• AERONET ground stations are critical in validating MODIS aerosol 
retrievals. We provide cut-outs of retrieved parameters near 
AERONET surface stations (both HDF and spreadsheet formats). 

• Product packaging bundles parameters into five products at Level 2 
including important imbedded diagnostics: cloud mask, atmospheric 
profiles, aerosol, water vapor and cloud parameters. 

• It’s important to make extensive use of embedded QA flags and 
diagnostic parameters such as cloud particle phase and multi-layer 
cloud flags. Aerosol diagnostics include path radiance, angstrom 
exponent, mass concentration, and pixels used per retrieval. 

• We produce approximately 800 global single-parameter images per 
day (each platform) to support QA and product quick looks. 
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Understand Algorithm Dependencies and 

Track Known Issues 




ATT 

ML 

fSjL 


I 

i 

» X p„ ._ T J 


'Zi~ 

Epfe* 


Missing Blocks (Retrieval Failure) in Cloud Optical Properties. Rectangular 
holes (Left Image) result from fill values in the 3-hour GDAS ancillary data set 
that cause Cloud Top Properties retrievals to abort. Cloud optical properties are 
dependent on prior cloud top temperature and pressure retrievals. 
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Algorithm Flaws Show Up in Histograms. 

So, Compute Many. 

Hitoqii KrSXn Thii iLmd Cnl^ 



Liquid water optical thickness over land was found to be flawed in early retrievals due to 
coding errors in the Rayleigh correction algorithm. Above is the probability distribution for 
liquid water optical thickness with values from 0-30 microns. The flaw appears as a deficiency 
at 12 microns. 
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Visualize Many Parameters 
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Daily atmosphere product maps support QA and are posted for 
general use by product users (above are 9 of 792 parameters). 



MODIS Land Lessons Learned 


Summary of MODIS Land 
Lessons Learned 



• Close interaction between the science team and the 
Science Data Support Team (SDST) allowed for timely 
decisions to be made on the production priorities and 
adjustments to be made to the production schedule so that 
early understanding of the product quality could be made 
while the data system was being improved. 

• Centralized QA group expedited handling a large number 
of interdependent algorithm changes by investigating 
quality problems and coordinating the geographically 
dispersed science team members. 

• Recognized the importance of validation and set up a 
centralized activity to coordinate validation of the Land 
products. 
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MODIS Land Products 




Energy Balance Product Suite 

-Surface Reflectance 

-Land Surface Temperature, 
Emmisivity 

-BRDF/Albedo 

-Snow/Sea-ice Cover 

Vegetation Parameters Suite 
-Vegetation Indices 
-LAI/FPAR 
-GPP/NPP 

Land Cover/Land Use Suite 


-Land CoverA/egetation 
Dynamics 

-Vegetation Continuous Fields 
-Vegetation Cover Change 
-Fire and Burned Area 
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MODLAND QA 

http://landweb.nascom.nasa.gov/cgi-bin/QA_WWW/newPage.cgi 



QA Summaries 
Known Issues 
Global Browse 
Time Series 



Product Quality: 

• Product Quality 

D o cumentation - T erra C- C 5 

• Known Pro duct I s sue s - T ena 

• Product Quality 7 
Documentation - Aqua 

• Known Fro duct I ; sue ; - Aqua 

• On use ofC5 withC4 


Product Definitions: 

• Product User Guides 

• Algorithm Iheoretical Basis 
Documents 

• Fro duct Interdep endencie s 

• Product File Specifications 

Science Team Links: 

• QA Tools 

• Land Science lest 

• Collection Changes 

• MOD APS Production and 
Data Ordering 

• Platform and Calibration 


Help/FAQ 
Global Browse 
Golden Tile Browse 
Time Series 
Animation 


Welcome to the MODIS Land 
Quality Assessment Site 


What is New! 

• Collection 5 data will be available 

• Land data can now be ordered thr 

• New inter-comparison time series 



Quality assessment (QA) is an integral part of the MODIS Land production chain. The 
objective of MODLAND QAis to ev aluate and document the scientific quality of the 
MODLAND products with respect to 


QA are made available on a routine ba 
per -pixel information. MODLAND Q^ 
pages located at this site. Users are enc 
use individual products to ensure that ti 
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Communicate Known Issues to team 

and community 
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Validation 






• Should be funded as an integral part of the product development 

• Some centralized validation coordination is needed 

- Makes effort more cost effective 

• Five stage product maturity and validation approach works well 

- Beta, Provisional, Validated Stage 1 to 3 

- Helpful for provisional data to be available for community feedback 

• Land: high resolution imagery and subsets for core validation sites 
were valuable 

• Learned from Terra: “validation should not be too soon after launch” 
was applied to Aqua 

- Products need to be stable 

- Aqua products were more mature before validation occurred 

• Useful to have Near Real Time images to support validation 
campaigns 
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Val Summaries 

EOS Core Sites 

Major Campaigns 

Val Metadata w. 
ORNL 

MODIS Validation 
Data sub sets 
w. EDC 


MODLAND Validation 
http://landval.gsfc.nasa.gov/ 




^ GODDARD SPACE FLIGHT CENTER 

+ NASA Herne- page 


MODIS land team 



Announcements: 


• View and comment on the 
ESDR White Papers 
developed by the NASA Land 
Measurement Team 

• MODIS Science Team 
Meeting, Oct. 31-Nov. 2, 
2006, at the University of 
Maryland. 

• Announcing. ... MODIS Land 
Collection 5 Workshop, Jan. 
17-13, 2007, University of 
Maryland, se« Draft Agenda. 

• Validation of glohal 
vegetation indices and their 
time series, a one -day 
workshop, August 7, 2006, 
Missoula, MT 

• Glohal Vegetation Workshop 
2006, August 3-10, Missoula, 

MT 

• TGARS Special Issue on 
Glohal Land Product 
Validation now available 


The Committee on Earth Observation Satellites ( CEOS % defines 
validation as the process of assessing f by independent means f the quality 
of the data products derived from the system outputs. 

The MODIS Land Validation Strategy 

MODIS Land (MODLAND) product quality is ensured by Calibration, 

Quality Assurance (QA) and Validation. The MODIS land validation effort 
will contribute to and leverage off of international validation activities, 
helping to establish standards and protocols through close coordination 
with the CEOS Land Product Validation (LPV’l subgroup, under its Working 
Group on Calibration and Validation (WGCV). 

MODLAND uses several validation techniques to develop uncertainty 
information for its products. These include comparisons with in situ data 
collected over a distributed set of validation test sites, comparisons with 
data and products from other sensors (e.g.. ASTER. AVHRR. MISR. 
TM/ETM+). intercomparison of trends derived from independently-obtained 
reference data, and analysis of process model results. 


MODIS News 


* Terra 

* Aqua 


MOD LAND'S primary validation technique includes the collection of field 
and aircraft data, and comparison with these and with products from other 
satellites. The infrastructure for these efforts has resulted in the 
establishment of a semi-permanent array of EOS Land Validation 

most of which include a flux tower for extended temporal 
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Conclusion 



• Many lessons learned in processing data should 
be applied to future missions 

- Operational NPP/NPOESS VIIRS Sensors 

- NASA research sensors (e.g. HyspIRI) 

- Similar international missions 


May 17, 2011 - Wolfe 


29 



Thank you! 


